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Image data compression. 



The invention relates to a method, a device and a transmitter, in which an 
image signal is encoded to obtain a bit-stream. The invention further relates to transcoding. 
The invention also relates to a receiver, a bit-stream and a storage medium. 



EP-0 5 14 663 A2 discloses an apparatus and method for motion video 
encoding employing an adaptive quantizer. The MPEG video standard defines a layered 
architecture for compressing a video sequence. First, a sequence of video pictures is 
subdivided into disjoint Groups Of Pictures (GOPs). Each GOP is compressed independently 
of other OOP's to facilitate random access to any picture and also to limit the propagation of 
transmission errors. Every picture in a GOP is subdivided into Macro-Blocks (MBs). For a 
color picture, an MB is a collection of 16x16 luminance pixels and two 8x8 blocks of 
chrominance pixels. In MPEG, the two chrominance components are both sampled at half the 
horizontal and vertical resolution of the luminance. As such, an MB completely describes a 
16x16 color segment of a picture. In an MB the 16x16 luminance pixels are further 
subdivided into four luminance blocks of 8x8 pixels. The still or motion picture data in the 
form of MBs, represented by either the actual pixel data (intra-mode) or only the error data 
(predictive), is inputted to a transformation. This transformation is a two-d im e n s i onal 
Discrete Cosine Transform (DCT) applied to each of the MBs. After applying the DCT, the 
resulting coefficients undergo a quantization step. The DCT transform coefficients are 
uniformly quantized with a matrix of quantization steps. MPEG specifies one of two 
reference matrices from which the quantization steps may be derived. The choice of which 
matrix is used, depends on the MB mode. Although the reference matrices can be defined by 
the encoder at the beginning of a video sequence, they remain fixed afterwards. MPEG 
allows dynamic changes to the matrix of quantization steps, however, by allowing a scaling 
factor for the reference matrices. This scaling factor can be changed for every MB. The 
adaptation of this scaling factor is performed on an MB to MB basis and varies based on the 
complexity of the image and the available rate control requirements. 
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An object of the invention is to provide further compression. To this end, the 
invention provides a method, a device, a transmitter, a transcoder, & receiver, a bit-stream and 
a storage medium as defined in the independent claims. Advantageous embodiments are 
defined in the dependent claims. 
5 In a first embodiment of the invention, blocks of transform coefficients are 

provided and high-frequency transform coefficients are attenuated The invention is based on 
the insight that especially for obtaining low bit-rates, attenuating high-frequency transform 
coefficients is more advantageous than increasing a step-size for all transform coefficients. 
Increasing the step-size causes accumulation of errors in predictively coded pictures, because 
10 each predictively coded picture is predicted from a previous picture. In this way, errors will 
accumulate over a GOP. A resulting coding artifact can be seen as "breathing" of the picture 
quality over a time interval of a OOP which is normally about half a second. The invention 
provides further compression by attenuation of high-frequency coefficients. Lower 
frequencies are less or not attenuated. Preferably, some of the coefficients of lower 
1 5 frequencies remain unaffected. The accumulation of errors is herewith reduced. 

For attenuating high frequency coefficients, the invention provides a curve 
with higher quantization step for higher-frequency transform coefficients. Because no curve 
information is put in the resulting bit-stream, the reconstruction is performed by using an 
original quantization scaling factor only. The quantization according to the invention can be 
20 seen as additional quantization, which is not taken into account in a reconstruction. 

Therefore, a reconstructed coefficient will have a lower value than an original coefficient 
The bit rate can easily be regulated by shifting die curve to lower or higher 
frequencies and/or multiplying the curve. 

The aforementioned and other aspects of the invention will be apparent from 
25 and elucidated with reference to the embodiments described hereinafter. 



In the drawings: 

Fig. 1 shows a block of transform coefficients; 
30 Fig. 2 shows an illustration of perceived picture quality as function of time 

when a higher step-size is used to encode an image signal; 

Fig. 3 shows a preferred quantization curve according to the invention; 
Fig. 4 shows an embodiment of a transmitter according to the invention; 
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Fig. 5 shows an embodiment of a receiver according to the invention 

i 

comprising a bit rate trans coder; and 

Fig. 6 shows a further bit rate transcoder that may be included in the receiver 

of Fig. 5. 

The drawings only show those elements thai are necessary to understand the 

invention. 



10 



15 



20 



25 



30 



Fig. 1 shows a block of transform coefficients. These coefficients G are 
obtained by transforming a block of data from a spatial domain to a frequency domain. In this 
example, a picture Is encoded per block of 8 by 8 pixels. The result of the transformation is a 
block of 8 by 8 transform coefficients (so i- 0...63). From the left to the right in the block, the 
horizontal spatial frequency increases. From the top to the bottom, the vertical spatial 
frequency increases. The upper-left coefficient Co represents a DC coefficient Although 
various transformations may be used, preferably DCT tranrformation is performed. In Fig. 1, 
a zigzag scanning is used to obtain an order of transform coefficients C, Although another 
scanning may be used, zigzag scanning is widely used, e.g. in MPEG. 

In MPEG, coefficients Q are quantized by dividing them by a weight in a 
predefined quantization matrix and by a quantization scaling factor. The quantization scaling 
factor is adapted per macro block. The weights in the quantization matrix are so arranged that 
me less important coefficients are coded with less accuracy. 

One way of reducing a bit rate would be to use a higher quantization scaling 
fector. Errors introduced by using a higher quantization scaling factor affect the picture 
quality, in a predictive coding method, like MPEG, errors in a given picture affect another 
picture when the given picture is used to predict the other picture. The degradation of intra- 

coded pictures is usually limited. 

An error made in a picture that is used as a predictor is forwarded to a 

predicted picture. Accumulation of errors takes place, depending on the number of 
predictions that is made. The accumulation of errors gives rise to annoying effects. The 
perceived quality between a ^ginning and an end of a GOP differs significantly. This effect 
is illustrated in Fig. 2. A Perceived picture quality Ppq is shown as function of time t This 
effect may be called •breathing'', U. the Ppq decreases during a GOP and increases suddenly 
with a new, refreshing I picture. 
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Attenuating high-frequency coefficients Q according to the invention reduces 
this accumulation of errors. The coefficients are quantized with an additional quantization 
step si2e Qadd. Because this additional quantization step is not put in the resulting hit-stream, 
the reconstruction is performed wife the quantization scaling factor and the quantization 
5 matrix without taking into account the additional quantization. Therefore, a reconstructed 
coefficient will have a lower value than an original coefficient Q. As a result, the coefficient 
Cj has been attenuated. To reflect the lower importance of higher frequencies, the DCT 
coefficients are quantized with a variable quantization step depending on their position. Fig. 
3 shows a curve QC showing the additional quantization step size Qadd as a function of a 

1 0 position of the quantized transform coefficient Q. The quantization step Qadd gradually 
increases for higher-frequency transform coefficients C\. The lowest coefficients Q are not 
affected, keeping their value from the incoming stream. This is done to protect the low 
frequencies to which the eye is very sensible. In a practical embodiment 8 coefficients always 
remain unaffected Keeping the lower frequencies unaffected, is advantageous in preventing 

15 the accumulation of errors. 

It would have been possible to remove every coefficient after a given position 
in the DCT coefficient order. However, due to a particularity of the DCT, that would have 
given rise to a deterioration of lower frequencies, In fact, the DCT is a kind of bank filter, 
which extracts a value for a range of frequencies, i.e. a DCT coefficient The bank filter is 

20 however imperfect in that frequency ranges overlap each other. This means that a DCT 
coefficient contains energy in a quite large band. Therefore, quantizing a coefficient has 
some repercussions on lower frequencies. Thus, removing complete coefficients after a given 
position would not only remove the energy contained in high frequencies but also some 
energy contained in lower frequencies, because even a high frequency coefficient contains 

25 energy in lower frequencies. Attenuating is therefore better than removing transform 

coefficients Q, A smoothly increasing step- size is advantageous regarding the removing of 
energy from lower frequencies. In a practical embodiment, a logarithmic function is used. 

For bit rate control, the curve QC may be shifted. The curve QC is shifted to 
the left to reduce die bit rate and shifted to the right to increase the bit rate. Preferably, some 

30 lower frequency transform coefficients should not be additionally quantized. If lower 
frequencies remain untouched, less errors are accumulated. 

For further bit rate control, the curve QC may be multiplied by a certain 
multiplier. In case the multiplier is larger than one, the coefficients are more coarsely 
quantized and the bit rate is further reduced. In case the multiplier is smaller than one, the 
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coefficients are less coarsely quantized and the bit rate is increased. Shifting and multiplying 
may be performed in combination or independently. 

Advantage may be taken from the prediction tree to avoid the propagation of 
errors. Instead of quantizing pictures heavily at the beginning of a prediction sequence, it is 
5 advantageous to quantize last pictures in a prediction sequence more heavily. In this way. 
predictions are made from rather good images. In a OOP with one I (intra-coded) picture 
followed by P (predictively coded) pictures, a last P picture may be quantized more heavily. 
Since about 25 pictures are displayed per second, one picture is displayed for only 0.04 
second. During this very short lap of time, the human eye does not observe a drop in quality. 
10 Squeezing me last P picture is possible resulting in an extreme low number of bits used. The 
current P picture is of low quality, but this is no problem because the viewer does not notice 
the drop in quality and the last P picture is not used to predict another picture. This strategy 
can also be used for B (bi-directional predictively coded) pictures as they are also at an end 
of a prediction sequence. Generally, the B-pictures cannot be quantized as coarsely as the last 
15 P-picture, since there are more than one B pictures in a OOP and repetitive drops in quality 
wimin a TOP tend to lower^^obaTquality of the image as perceived. This strategy does 
not cause a breathing effect because errors that are forwarded to other pictures are smaller. 
Although it is possible to quantize more than one last P-picture more coarsely, this is less 
advantageous. 

20 As discussed above, quantizing pictures more coarsely can be achieved by 

shifting or multiplying the quantization curve. 

Fig. 4 shows an embodiment of a transmitter according to the invention. The 
transmitter 1 comprises means for obtaining a signal S, e.g. a camera 10. The transmitter 
further comprises an encoding device 2. Although not necessary to the invention, the 
25 encoding device preferably encodes the image signal by using motion estimation and motion 
compensation. The device 2 therefore comprises a motion compensator MC 11 and a motion 
estimator ME 18. The motion compensator 11 furnishes a motion compensated difference 
signal to a transform coder 12. This transform coder 12 preferably applies a DCT 
transformation on the motion compensated signal. After the transformation, the transformed 
30 signal is quantized in quantizer Q 13. This is a standard quantization as is known from the 
prior art. to perform motion estiniatibnTa Treronstructed picture is necessary. Therefore, the 
device 2 comprises an inverse quantizer IQ 1 4 and an inverse transform coder IDCT 1 5 that 
perform inverse operations of Q 13 and DCT 12 respectively. In the inverse motion 
compensator IMC 16" that is coupled to the ME 1 8 the reconstructed picture is obtained. The 
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reconstructed picture is stored in the picture memory MEM 1 7. The reconstructed picture is 
used for motion estimation in a next picture that has to be encoded. The quantized motion 
compensated signal as obtained in Q 13 is furnished to an additional quantizer Qadd 19 
according to the invention. The Qadd 1 9 applies an additional quantization to the signal with 
5 a curve as shown in Fig, 3. The signal is thereafter encoded in the Variable Length Encoder 
VLE 20 to obtain a video elementary stream V. A bit rate R of the video stream V is derived 
in VLE 20 and furnished to CPU 2 1 . The CPU 2 1 is coupled to Qadd 1 9 to control the bit 
rate by shiftin g and/ or multiplying the curve. The CPU 21 also controls other parts of the 
device 2. Qadd may be defined for blocks of 8x8 pixels. The quantization scale fector used in 
10 Q 13 is defined per macroblock. 

The Qadd is preferably located outside the encoding loop MC 1 1...ME 18. 
This means that e.g. for motion compensation, a better quality is available than from the 
additionally quantized signal. This is important, because a good quality of the reconstructed 
picture means that better encoding can be obtained, in the case of motion compensation due 
IS to a belter motion estimation. The better motion estimation is performed, the better is the 
compression of die signal S. The video stream V is multiplexed with other streams, e.g. an 
audio elementary stream A in a multiplexer 22 to obtain a transport/ program stream TS. 

Coding bit-streams from an original bit-rate Rl to a new bit-rate R2 is called 
bit-rate transcoding. Bit-rate transcoding is e.g. performed to unify incoming bit-streams that 
20 vary in bit-rate. Further, the bit rates used for broadcasting are usually too high for storage on 
digital storage media, given the condition that enough playing time should be available. 
Therefore, bit rate reduction is often necessary. Furthermore, for implementation of long-play 
mode a low bit rate is required. The invention is preferably applied in a bit rate transcoder. 
Such a bit rate transcoder may be included in a digital video recorder. A common practice for 
25 bit rate transcoding is cascading a decoder and an encoder. A common decoder may be 
cascaded with an encoder according to the invention, which encoder attenuates high- 
frequency transform coefficients of DCT blocks, e.g. the encoder 2 from Fig. 4. 

Fig. S shows an embodiment of a receiver (e.g. digital video recorder like D- 
VHS). The receiver 3 comprises receiving means 4 and a preferred bit rate transcoder 5. An 
30 incoming transport/ program stream TS1 is received in receiving means 4, e.g. an antenna 
system, and thereafter demultiplexed in a demultiplexer SO to obtain a video elementary 
stream VI and an audio elementary stream Al, Hie transport stream TS1 may be transmitted 
by an embodiment as shown in Fig. 4. The video elementary stream VI is passed to a 
Variable Length Decoder (VLD) 51 to obtain blocks of transform coefficients Q. The audio 
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elementary stream Al is bypassed because transcoding an audio elementary stream will 
hardly affect the bit rate. After the VLD 51, the decoded video stream is furnished to a 
quantizer Qadd 52 according to the invention. In Qadd 52, the higher frequency coefficients 
are attenuated as explained above. The additional quantized video stream is furnished to a 
5 Variable Length Encoder (VLB) 53 to obtain a new video elementary stream V2. As in Fig. 
4, a bit rate R2 is derived in the VLE 53 and furnished to a CPU 54 to control the Qadd 52. 
The new video stream V2 is multiplexed together with the parsed audio stream Al in a 
multiplexer 55 to obtain a new transport stream TS2. The new transport stream TS2 has a 
lower bit rate than the incoming transport stream TS1. The new transport stream TS2 may be 
1 0 stored on a storage medium 6. The storage medium 6 may be a DVD, a CD-ROM, a (D- 
VHS) tape, etc. 

Fig. 6 shows a further preferred bit rate transcoder 7, which may replace the 
transcoder 5 in the receiver of Fig. 5. The transcoder 7 is derived from a full decoder-encoder 
cascading and is based on a simplification of the encoder part In a full decoder-encoder, the 
1 5 encoder computes motion vectors. These motion vectors are only used to construct a bit- 
stream in the encoder. It is likely that the motion vectors found by the motion estimation in 
the encoder of the full decoder-encoder are not different from the motion vectors v in an 
original bit-stream. Or, at least, new motion vectors refer to macro-blocks, which values are 
dose to the values of macro-blocks referred to by the original vectors. Therefore, it is a great 
20 improvement from a complexity point of view to reuse the original motion vectors in the 

transcoder. In the transcoder 7, quantized transform coefficients are dequantized in an inverse 
quantizer 70 to obtain dequantized transform coefficients. The dequantized transform 
coefficients are ^quantized in a quantizer 72. In Fig. 6, a feedback loop is illustrated for 
compensating a requantization error, which is due to a new, higher quantization step size in 
25 the quantizer 72. This extra quantization introduces extra coding errors. In order to prevent 
leakage of these errors, these errors are compensated. As these errors affect images which are 
predicted from the current image, motion compensation is applied to these errors in motion 
compensator 77 with use of the original motion vectors v. The motion compensated errors are 
subtracted from a next anchor frame in subtracter 71. Therefore, the reconstructed image will 
30 not be affected by the error made in the previous image. This avoids error accumulation. The 
feedback loop further comprises an inverse quantizer 73. a subtracter 74 and an inverse DCT 
unit 75 to obtain the ^quantization error. A memory 76 stores the requantization error. The 
motion compensated error is transform coded In a DCT unit 78 to furnish a transform coded 
motion compensated requantization error to the dequantized signal. In case the motion 
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compensator 77 is suitable for performing DCT domain motion compensation, the IDCT unit 
75 and the DCT unit 78 may be omitted. 

The complexity of the bit rate transcoder according to Fig. 6 is lower than the 
full decoder-encoder. Nevertheless, the complexity is higher than the bit rate transcoder 5 of 
Fig. 5. 



Due to the extreme low complexity of the proposed algorithm by the present 
invention, it is well suited for applications, especially for transcoding, which demand high 
throughput, like High Definition bit-streams. HD bit-streams can be re-quantized to a lower 

10 bit-rate, while the resolution remains the same, A preferred application of the invention 
reduces the bit-rate of an HD~stream for storing the lower bit-rate HD-stream on a storage 
medium. Another preferred application is a long play mode in Standard Definition (SD). 

It should be noted that the above-mentioned embodiments illustrate rather than 
limit the invention, and that those skilled in the art will be able to design many alternative 

15 embodiments^ without departing from the scope of the appended claims. The word 4 picture' 
also refers to frame, field, etc. In the claims, any reference signs placed between parentheses 
shall not be construed as limiting the claim. The word 'comprising 1 does not exclude the 
presence of other elements or steps than those listed in a claim. The invention can be 
implemented by means of hardware comprising several distinct elements, and by means of a 

20 suitably programmed computer. In a device claim enumerating several means, several of 
these means can be embodied by one and the same item of hardware. The mere fact that 
certain measures are recited in mutually different dependent claims does not indicate that a 
combination of these measures cannot be used to advantage, 

In summary, a method and a device are provided, wherein a signal is encoded 

25 to obtain a bit-stream, Blocks of quantized transform coefficients are provided. Transform 
coefficients corresponding to higher frequencies are attenuated. For attenuating high 
frequency coefficients, the invention provides a curve QC with higher quantization step-size 
Qadd for transform coefficients Q corresponding to higher frequencies. Because this 
additional quantization step size Qadd is not put in the resulting bit-stream, a reconstruction 

30 is performed with an original quantization step step-size, without taking the additional 

quantization into account Therefore, a reconstructed coefficient will have a lower value than 
an original coefficient C,\ Bit rates can easily be regulated by shifting the curve QC to lower 
or higher frequencies and/or multiplying the curve QC. 



CLAIMS: 



9 



10.03.2000 



! A method of encoding (2) a signal (S) to obtain a bit-stream (V.TS), the 

method comprising me steps of: 

providing (12,13) blocks of quantized transform coefficients (CO; and 
attenuating (1 9) high-frequency transform coefficients (CO of a given block. 

2 A method as claimed in claim 1. the step of attenuating comprising: 
quantizing (19) the transform coefficients (CO of the given block with a curve 

COO having higher quantization steps (Qado) for higher-frequency transform coefficients 
(CO, without putting information concerning said curve (QC) into the bit-stream (V,TS). 

3 A method as claimed in claim 2, 

farther comprising the step of shifting (19,21) the curve (QC) to adjust a bit 

rate (R) of the bit-stream (V.TS). 

4 A method as claimed in claim 2, 

further comprising the step of multiplying (19,21) the curve (QC) to adjust a 

bit rate (R) of the bit-stream (V ,TS). 

5 . A method as claimed in claim 2, wherein the signal (S) comprises mtra-coded 

amir*^cuvelycodedp ^ _ 

quantizing (19,21) predictively coded pictures at an end of a prediction 
seq^ .nore coarsely tr^ predictively coded pictures a. a sta^ 

, A met hod as claimed in claim I , the method further comprising the steps of: 

decoding (14,15) the blocks of quantized transform coefficients (CO to obtain 

instructed P ^ 
transform coefficients (CO- 
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7. A device (2) for encoding a signal (S) to obtain a hit-stream (V,TS), 

comprising: 



means (12,13) for providing blocks of quantized transform coefficients (d); 



and 



5 means (19) for attenuating high-frequency transform coefficients (Q) of a 

given block. 

8. A transmitter (1) comprising: 

means (10) for obtaining a signal (S); and 
1 0 a device (2) for encoding the signal (S) as claimed in claim 7. 

9. A method of transcoding (5) an encoded signal (TS 1,V1), comprising the steps 
of: 

decoding (50,51) the encoded signal (TS1,V1) to obtain blocks of quantized 
1 5 transform coefficients (Q); and 

attenuating (52) high-frequency transform coefficients (C|) of a given block. 

^10. A bit rate transcoder (5) for transcoding an encoded signal (TS 1,V1) 

comprising: 

20 means (50,51) for decoding the encoded signal (TS1.V1) to obtain blocks of 

quantized transform coefficients (Q); and 

means for attenuating (52) high-frequency transform coefficients (Q) of a 

given block, 

25 11. A bit rate transcoder (7) as claimed in claim 10, the bit rate transcoder (7) 

further comprising: 

means (70,72) for requantizing the quantized transform coefficients to obtain 
requantized coefficients; and 

a feedback loop (73*78,71) for compensating a requantization error, 
30 the means for attenuating (52) being arranged to flttmnate high-frequency 

coefficients in blocks of the requantized coefficients. 



12. A receiver (3) comprising: 

means (4,50) for obtaining an encoded signal (TSl.Vl); and 
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a bit rate transcoder (5) for transcoding the encoded signal (TSl.Vl) as 
claimed in claim 10. 

13 A bit-stream (V,TS S V2,TS2) comprising blocks of quantized transform 

coefficients (CO. wherein high-fiequency transform coefficients (Cj) of a given block have 
been attenuated. 



14. A storage medium (6) on 

claim 13 is stored. 



which a bit-stream (V,TS,V2,TS2) as claimed in 
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ABSTRACT: 
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A method and a device are provided, in which a signal is encoded to obtain a 
bit-stream. Blocks of quantized transform coefficients are provided. Transform coefficients 
corresponding to higher frequencies are attenuated. For attenuating high frequency 
coefficients, the invention provides a curve (QC) with higher quantization step-size (Qadd) or 
transform coefficients (CO corresponding to higher frequencies. Because this additional 
quantization step size (Qadd) is not put in the resulting bit-stream, the reconstruction is 
performed with an original quantization step-size, without taking the additional quantizing 
into account. Therefore, a reconstructed coefficient will have a lower value than an original 
coefficient (CD. Bit rates can easily be regulated by shifting the curve (QC) to lower or higher 
frequencies and/or multiplying the curve (QC). 
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